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Asymptotic Capacity Results for 
Non- Stationary Time- Variant Channels Using 

Subspace Projections 

Thomas Zemen* and Stefan M. Moser 

Abstract 

In this paper we deal with a single-antenna discrete-time flat-fading channel. The fading process is 
assumed to be stationary for the duration of a single data block. From block to block the fading process 
is allowed to be non-stationary. The number of scatterers bounds the rank of the channels covariance 
matrix. The signal-to-noise ratio (SNR), the user velocity, and the data block-length define the usable 
rank of the time-variant channel subspace. The usable channel subspace grows with the SNR. This 
growth in dimensionality must be taken into account for asymptotic capacity results in the high-SNR 
regime. Using results from the theory of time-concentrated and band-limited sequences we are able 
to define an SNR threshold below which the capacity grows logarithmically. Above this threshold the 
capacity grows double-logarithmically. 

Index Terms 

Non-coherent capacity, non-stationary time-variant channel, Slepian basis expansion, Fourier basis 
expansion, prolate spheroidal sequences. 

I. INTRODUCTION 

In this paper we deal with a single-antenna discrete-time flat fading channel. The fading 
process is assumed to be stationary and Gaussian for the duration of a single data block of 
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length M. From block to block the fading process is allowed to be non- stationary, i.e., we 
assume the fading to be independent across blocks. We analyze the validity of subspace based 
channel models for obtaining high signal-to-noise ratio (SNR) capacity results. 

In wireless communication system the time- variation of the communication channel is caused 
by Doppler effects due to user movement and multipath propagation. The Doppler bandwidth of 
the channels time-variation is defined by the velocity of the user. The symbol rate is typically 
much higher than the maximum Doppler bandwidth. 

In [1] the capacity of a non-coherent block-stationary fading model is analyzed and the 
pre-log (i.e., the ratio of capacity to log SNR in the limit when the SNR tends to infinity 
limgNR^oo ^g S ^^ ) is derived. The pre-log depends critically on the rank of the covariance matrix 
of one fading block. In order to estimate this rank for realistic scenarios Liang and Veeravalli 
use in [1] a subspace projection on Fourier basis functions [2]. Their derivation, however, lacks 
several important points: 

• A projection of the time-variant channel h[-] on a subspace makes only sense in a context 
where h[-] needs to be estimated, e.g., from the observed channel output symbols. This 
means that the estimation becomes dependent on the SNR. 

• Any estimation problem is based on a criterion that allows to specify the quality of a 
particular estimate. In [1] no such criterion is given. We propose to use a mean square error 
(MSE) criterion. 

• Once the problem of defining a subspace is understood as estimation problem with a given 
quality-criterion, it becomes obvious that the choice of the basis functions strongly influences 
the estimation error. In particular, the Fourier basis expansion, i.e., a truncated discrete 
Fourier transform (DFT), has the following major drawback in describing a time-variant 
channel: the rectangular window associated with the DFT introduces spectral leakage [3, 
Sec. 5.4], i.e., the energy from low frequency Fourier coefficients leaks to the full frequency 
range. Furthermore, the truncation causes an effect similar to the Gibbs phenomenon [3, 
Sec. 2.4.2]. This leads to significant phase and amplitude errors at the beginning and at the 
end of a data block, and hence to a deteriorated MSE. 

• The choice of the dimension of the subspace has to be made in the context of the estimation 
problem. Hence, the optimum dimension will depend on the SNR by the trade-off between 
the square bias and the variance [4], [5]. 
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We suggest two subspace projections that give a significantly better MSE than the Fourier 
basis expansion of [1]: 

• The Slepian basis expansion, as introduced in [4] based on concepts from the theory of 
time-concentrated and band-limited sequences [6], offers a square-bias reduction of more 
than one magnitude compared to the Fourier basis expansion [4]. 

• The Karhunen-Loeve expansion provides the optimum basis functions in terms of a mini- 
mum MSE when the second order statistics are known. 

Contribution: 

• We adapt the results from [1] taking into account the SNR-dependent subspace dimension. 

• We define a SNR threshold below which the capacity grows logarithmically. Above this 
threshold the capacity grows double-logarithmically. This result allows to bridge the gap 
between the results from [1] and [7]. 

The rest of the paper is organized as follows: 

The notation is presented in Section |TT| and the signal model for flat-fading time-variant 
channels is introduced in Section |ni| We provide the time-variant channel description based 
on physical wave propagation principles in Section |IVJ Subspace based channel models are 
reviewed in Section |V| building the foundation for the capacity results in Section |VH which build 
on [1]. In Section IVTII numerical results for the begin of the double-logarithmic capacity region 
are presented. We draw conclusions in Section IVIIII 



II. Notation 



A 



a 



column vector with elements a[i] 
matrix with elements [A]^ 



A T , A 1 

diag(a) 

Iq 



H 



transpose, conjugate transpose of A 

diagonal matrix with entries a[i] 

Q x Q identity matrix 

complex conjugate, absolute value of a 

largest integer, lower or equal than a E R 

smallest integer, greater or equal than a E R 

£ 2 -norm of vector a 



a*, \a 



Laj 
\a] 



a 
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III. Signal Model for Flat-Fading Time-Variant Channels 

We consider the transmission of a symbol sequence d[m] with symbol rate i?g = 1/T S over 
a time-variant flat-fading channel. The symbol duration is much longer than the delay spread 
of the channel T s 3> T D . Discrete time is denoted by m. The channel in equivalent baseband 
notation h(t, r) incorporates the transmit filter, the physical channel and the matched receive 
filter. 

Hence, we consider a discrete time model where the received sequences y[m] is given by 
the multiplication of the symbol sequence d[m] and the sampled time- variant channel h[m] = 
h(mT$, 0) plus additional circular symmetric complex white Gaussian noise z[m] 

y [m] = VSNRh{m]d{m] + z[m] , m G {0, . . . , M - 1} . (1) 

The transmission is block oriented with block length M. The time-variant channel is assumed to 
be independent from block to block. We normalize the system so that the channel inputs d[m] 
have power constraint 1 |<i[m]| 2 = 1, the channel coefficients h[m] are circular symmetric complex 
Gaussian distributed with zero mean, h[m] ~ C7V(0, 1), and z[m] is a sequence of independent 
and identically distributed (i.i.d.) CA/"(0, 1) random variables. The term SNR presents the signal- 
to-noise ratio. 

IV. Physical Wave Propagation Channel Model 

We model the fading process using physical wave propagation principles [8]. The impinging 

wave fronts at the receive antenna are caused by P scatterers. The individual paths sum up as 

p-i p-i 
h[m} = J2 a p e i2nf ? Tsm = a P ^ Upm ■ (2) 

p=0 p=0 

Here f p G K is the Doppler shift of path p. For easier notation we define the normalized Doppler 
frequency as u p = f p Ts. The attenuation and phase shift of path p is denoted by a p G C. The 
Doppler shift of each individual path p depends on the angle of arrival a p in respect to the 
movement direction, the users velocity v, and the carrier frequency fc, 

vfc 

u p = Ts cos a„ . (3) 

c 

'We consider here for mathematical convenience a peak-power constraint instead of the more common average-power 
constraint. We believe that this assumption does not influence the results very much. See also the results and remarks in 
[7, Sec. XI]. 
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The speed of light is denoted by c . The one sided normalized Doppler bandwidth is given by 

v fa 

z/ D = -^T s >\v p \. (4) 
Co 

It is assumed that a p and v v for p £ {0, . . . , P — 1} are independent of each other and that both 
parameter sets are i.i.d.. 

We assume a time-variant block fading channel model. In this model the path parameters 
a p and u p are assumed to be constant for the duration of a single data block with length M. 
Their realization for the next data block is assumed to be independent. The fading process for 
the duration of a single data block is stationary, however from block to block the fading is 
non-stationary. This assumption is validated by measurement results from [9], [10]. 

We define the covariance matrix 

S h = E{hh n } (5) 
where the channel coefficients for a single block with length M are collected in the vector 

h = [h[0},h{l},...,h[M-l}f. (6) 
Referring to © it is clear that the rank of Y, h is given by 

rank(S h ) = min(P, M) = Q (7) 

for v > 0. 

V. Subspace Channel Description 

In this paper, we deal with non-stationary time-variant channels. For channel estimation at 
the receiver side, noisy observations y[m] for m £ {0, . . . , M — 1} are used. Thus, for channel 
estimation at the receiver side the effective covariance matrix 

S h = E fc + g^lM (8) 

is essential, which takes into account the noise level at the receiver side. 

We consider a subspace based channel description which expands the sequence h[m] in terms 
of D orthogonal basis function Ui[m] for i £ {0, . . . , D — 1} 

D-l 

h[m] Rj h[m] = itj[m]7j , (9) 

i=0 
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where m £ {0, . . . , M — 1}. 

Due to the orthogonality of the basis functions we can estimate the basis expansion coefficients 
7i according to 

M-1 

7i = tt*[m]rf*[m]?/[m] . (10) 

Knowledge of the data symbols d[m] can be achieved through an iterative estimation and 
detection scheme [11]. 

The purpose of a subspace based channel model is to minimize the mean square error (MSE) 
by selecting appropriate basis functions Ui[m] and the correct subspace dimension D. The MSE 
of the basis expansion is defined as 



1 f 

msem = — E M- 



M-1 2 



[m] — h[m] 



(11) 



m=0 

It is shown in [4], [12] that MSE A / can be described as the sum of a square bias term and a 
variance term 

MSEa/ = bias M + varjv/ . (12) 

These two terms show different behavior with respect to the SNR and the subspace dimension 
D. The square bias bias M is independent of the SNR and gets smaller with increasing subspace 
dimension D. While the variance var M increases with D and with the noise variance 1/SNR. 
Thus, the subspace dimension D defines the bias-variance tradeoff for a given SNR level [5]. 

In the following sections we will review different possibilities for the definition of the subspace 
spanned by the basis functions Ui[m] for i £ {0, . . . , D — 1} and m £ {0, . . . , M — 1} and for 
selecting the subspace dimension D. 

A. Karhunen-Loeve Expansion 

In general, if the second order statistic Yi h of the fading process is known, the Karhunen-Loeve 
expansion [13] provides the optimum basis functions in terms of minimum MSEm- The basis 
functions for the Karhunen-Loeve subspace are defined by 

T, h Ui = A-Uj (13) 

where Ui £ C M has elements wjm]. The eigenvalues are sorted in descending order. The 
variance in d 1 2b is given by 

™™ = SsM ' (14) 
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and the square bias can be expressed as 



-i 



bias^ = ^A:, (15) 

i=D 

where Q denotes the rank of the co variance matrix S^. 

The subspace dimension that minimizes MSE M for a given SNR is found as [5] 

D = J ,«Ss,(S Ai+ ™) e{1 -- 0} - <16) 

Thus, the subspace dimension D is defined by taking into account the SNR. A similar approach 
is used in [7], [14] for stationary time-variant channels. 
We define the notation 

U a ; b = [U a , ...,U b ] (17) 

which collects the eigenvectors u a , u a+ i, . . . , it&. Similarly we define the diagonal matrix 

A' a:6 = diag([A;,...,A' 6 ]). (18) 
With this definition we can partition ll h © as 



— ^o : r>-iA 0: r>-i£^D-i + U d .q-\A. d .q-\U 1 % > .q_ 1 + g^r^M • (19) 



Su(SNR) E N "(SNR) 

The subspace based channel estimation actually models the covariance matrix of the useable 
channel subspace Etj(SNR) only. The noise subspace S N (SNR) is suppressed. Thus, matrix 
Su(SNR) is also the one that will be relevant for the capacity calculations in Section IvTl 



B. Fourier Basis Expansion 

Without detailed knowledge of "E h it is possible to define a subspace based on the normalized 
Doppler bandwidth u D only. In this case the Fourier basis expansion is a first reasonable choice. 
The Fourier basis functions are defined as 

m\ - n i--D( F ) 12+1/2 

uf ] [m] = , (20) 



for % G {0, . . . , D^} and m G {0, . . . , M — 1}. The dimension is selected as 

£>( p ) = 2[u D M\ + 1. (21) 
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The drawbacks of the Fourier basis expansion due to spectral leakage [3, Sec. 5.4] and the 
Gibbs phenomenon [3, Sec. 2.4.2] are well known [15], [16]. The mismatch between the Fourier 
basis functions u^fm] (l20l) . which have discrete frequencies l ~ D( ^ 2+1 ^ 2 , and the physical wave 
propagation model ©, where the normalized Doppler frequencies are real valued, lead to an 
high square bias [4], [15]. 

In order to find a better suited basis expansion model Zemen and Mecklenbrauker [4] introduce 
the Slepian basis expansion for time-variant channel modeling. It is shown in [4] that the 
Slepian basis expansion offers a square bias reduction of more than one magnitude compared to 
the Fourier basis expansion. The most important properties of the Slepian basis expansion are 
reviewed in the next section. 



C. Slepian Basis Expansion 

Slepian [6] answered the question which sequence is bandlimited to the frequency range 
[— z/d,^d] and simultaneously most concentrated in a certain time interval of length M. The 
sequence u[m] we are seeking shall have their maximum energy concentration in an interval 
with length M 

M-l 

E \u[m}\ 2 

\(v D ,M) = ^ , (22) 

E | u [m] | 2 



m=— oo 



while being bandlimited to z/ D , hence 

u[m] = 
where 



U(v)fj 2mnu dv (23) 



U(u) = J2 «He" j2 ™"- (24) 

m=— oo 

We see that < A(r/ D , M) < 1. 

The solution of this constrained maximization problem are the discrete prolate spheroidal 
(DPS) sequences [6]. The DPS sequences Ui[m, u^,M] are defined as the real-valued solution 
of 



E Sin(2 T? (£ ^W , "D, M] = \(u Dj M) Ui [m, un, M] (25) 
^-^ nit — m) 



February 1, 2008 



DRAFT 



IEEE TRANSACTIONS ON INFORMATION THEORY, SUBMITTED (MAY 10, 2005). 



9 



for i £ {0, . . . , M — 1} and m £ {— oo, . . . , 00} [6]. For the remainder of the paper we drop the 
explicit dependence of Ui[m] and Aj on and M. 

The DPS sequences are doubly orthogonal on the infinite set {— 00, . . . , 00} = Z and the 
finite set {0, . . . , M — 1}. The eigenvalues A; are clustered near one for i < \2v D M~\ and decay 
rapidly for i > \2uy)M~\. Therefore, the signal space dimension [6, Sec. 3.3] of time-limited 
snapshots of a bandlimited signal is approximately given by [17] 

D' = \2u D M] + 1 . (26) 

Albeit their rapid decay the eigenvalues stay bounded away from zero for finite M. 

For our application we are interested in Uj[m] for the time index set m £ {0, . . . , M — 1} 
only. We introduce the term Slepian sequences for the index limited DPS sequences and define 
the vector Ui £ R A/ with elements Ui[m] for m £ {0, . . . , M — 1}. 

The Slepian sequences U; t are the eigenvectors of matrix C 

Cui = XiUi (27) 

and the energy concentration measured by Aj are the associated eigenvalues [6]. Matrix C has 
elements 

sin [2K{i-e)w] 

C \i,t - T- ^ > 

iryi — 1) 

where i,£ £ {0, . . . , M - 1}. 

We note that C has full rank. The eigenvalue asymptotics for large M and large i > 2v D M 
are given by [6] 

A/ w — , (29) 

where 6 is implicitly given through 

i = [2u D M + (6/tt) log MJ . (30) 

In the next section we apply the subspace concept in order to obtain capacity results for 
non-stationary time-variant channels. 

VI. Asymptotic Capacity Results for High SNR 

In [1] capacity results based on the rank of the channel covariance matrix are derived. The 
authors in [1] use a subspace based channel description based on the Fourier basis expansion. 
However, the SNR dependent partitioning of in a useable subspace Su (fT9l and a noise 
subspace S N was not taken into account. 
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A. General Case 

From (fToT) we see that in the high-SNR limit the optimum dimension corresponds to the rank 

Q: 

lim D = Q. (31) 

SNR^oo 

Taking the partitioning ( fl9l) into account we can distinguish the following two general cases: 
1) Number of scatterers P equal or larger than the block length M, 

P > M . (32) 

From (EB and © we see that in the high-SNR limit 

lim D — M . (33) 

SNR^oo 

Thus, the useable channel subspace Hu becomes full rank. In this case the results in [1] 
provides an upper capacity bound as 

C(SNR) < log log SNR - 7 - 1 - log \' M ^ + o(l) (34) 

where 7 denotes Euler's constant which is defined as 

roc 

7 = -/ e~ v log y d j/ « 0.5772 .. . (35) 



A similar capacity bound for the stationary case is found in [7]. 
2) Number of scatterers P smaller than the block length M, 

P <M. (36) 

From <EU and © we see that in the high-SNR limit 

lim D = P < M . (37) 

SNR^oo 

Thus, the useable channel subspace Su is not full rank and the capacity grows asymptot- 
ically as [1] 

C(SNR) M-P 
s N teooloiSNR = — P— (38) 
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B. Flat Doppler Spectrum 

We can obtain more detailed results based on the knowledge of the eigenvalues of the useable 
covariance matrix. The theory of time-concentrated and band-limited sequences provides such 
knowledge for the specific matrix C (l28t . see Section IV-C1 We assume that the time-variant 
channel has a flat Doppler spectrum in the interval [— vb, vd\- If such a fading process is observed 
for the duration of a data block with length M, the covariance matrix results in 

V h =E{hh H } = -^-C. (39) 



The elements of matrix C are defined in 

We assume P > M. From d2"9l we know the smallest eigenvalue of C. Due to the relation 
d39l we can express the smallest eigenvalue of T, h as 

1 11 1 _ 2 M(l-2i/ D )-l 

^-, = ^A»- lM — — ;3jg ^ M -e- -« . (40) 
Thus, we obtain a capacity upper bound as 

C(SNR) < loglogSNR _ 7 _ l _ bg J- + n 2 M (I - 2u D ) - 1 + 

2z/ D log M 

We can use (fToT) in order to find the SNR threshold where the usable channel subspace becomes 
full rank D = M. This threshold is the SNR level where the MSE for the M — 1 dimensional 
subspace 

MSE M (M - 1) = A M -i + M ~ 1 S ^ R (42) 
becomes equal to the MSE for the M dimensional subspace 

MSE M (M) = ^-. (43) 



Thus we can write 



which results in 



M - 1 1 1 

Am - 1 + ^^snr^-sniu (44) 



SNR th = -^--^. (45) 



M X M -i 

Inserting (gHJ m <H3) we obtain the SNR threshold 



1 1 2Vn ( _ 2 A/(l-2i/ D )-l \ 2z/n _2 M(1-2u-d)-1 

SNR th = = — - ( 1 + e* iogM ) « — ^ (46) 
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below which the channel subspace is rank deficient. Thus, for SNR < SNR th the capacity 
increases logarithmically. For SNR > SNR t h the useable channel subspace is full rank and 
the capacity increase becomes double-logarithmic. A similar result for stationary time-variant 
channels is given in [7]. 

For fast fading channels where u D — > 1/2 all eigenvalues become identical A — \\ = . . . = 
Xm-i = 1 and 

lim SNR th = -1 . (47) 

In general it will be desirable to operate a communication system below SNR t h- In the next 
section we will provide some numerical evaluations for wireless communication systems. 

VII. Relevance For Practical Wireless Communication Systems 

In [10] the stationarity properties of wireless communication channels are analyzed by means 
of measurements. It is found that the fading process is stationary for a certain distance d expressed 
in multiples of the wavelength A = cq/ fc, 

d<8 8Ut X. (48) 

The stationarity distance d is the path length for which the set of scatterers that generate the 
fading process does not change. After the user has traveled a distance longer than d a new set 
of scatterers become active. For urban environments <5 stat ~ 100 [10]. 

For a given symbol duration T s we obtain a block length M that depends on the actual user 
velocity 

M(ud) = — = — , (49) 
_ vT s j I v D _ 

and thus also on the normalized Doppler bandwidth z/ D . 
Plugging J49t into (l46l) we obtain 

2uy) it — 

SNR th (<5 stat , vv) = — 1 + e 



V 



(50) 



/ 



We evaluate SNR th (5 st at, ^d) for 5 stat G {1, 10, 100} and u D e (0, 1/2) in Fig. □ 

For current communication systems like UMTS at fc = 2 GHz the normalized Doppler 
bandwidth is vq < 0.02. Thus, the double-logarithmic regime will not be reached. However, 
at higher carrier frequencies, e.g. fc = 60 GHz or for underwater communication systems these 
bounds become more important. 
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io J kt 2 io~ 1 io° 

v (normalized Doppler bandwidth) 



Fig. 1. Signal-to-noise ratio threshold SNRth that describes the boundary between logarithmic and double-logarithmic capacity 
growths. We plot results for a fading channel with stationarity time <5 s tat £ {1, 10, 100} (in multiples of wavelength). The 
normalized Doppler bandwidth vu is varied in the interval (10~ 3 , 1/2). 

VIII. Conclusions 

We have shown that the number of scatterers P bounds the rank of the channel covariance 
matrix. The SNR, the user's velocity v, and the data block length M define the usable rank of 
the channel subspace. 

The usable channel subspace grows with the SNR. This growth in dimensionality must be 
taken into account for asymptotic capacity results in the high-SNR regime. For P < M the 
asymptotic capacity grows logarithmically, while for P > M a double-logarithmic growth is 
obtained. 

Using results from the theory of time-concentrated and band-limited sequences, we are able 
to specify the SNR above which the double-logarithmic capacity region starts in the special case 
of a flat Doppler spectrum. 
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